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We examine Illinois educational data from standardized exams and analyze primary factors af¬ 
fecting the achievement of public school students. We focus on the simplest possible models: repre¬ 
sentation of data through visualizations and regressions on single variables. Exam scores are shown 
to depend on school type, location, and poverty concentration. For most schools in Illinois, student 
test scores decline linearly with poverty concentration. However Chicago must be treated sepa¬ 
rately. Selective schools in Chicago, as well as some traditional and charter schools, deviate from 
this pattern based on poverty. For any poverty level, Chicago schools perform better than those 
in the rest of Illinois. Selective programs for gifted students show high performance at each grade 
level, most notably at the high school level, when compared to other Illinois school types. The case 
of Chicago charter schools is more complex. In the last six years, their students’ scores overtook 
those of students in traditional Chicago high schools. 


I. INTRODUCTION 

Each year, public school teachers and administrators 
face the pressure of increasing the number of students 
who meet academic performance benchmarks. Standard¬ 
ized exams are a primary measure of this achievement. 
Despite the great differences in support available to dif¬ 
ferent groups of students, all schools are tested by the 
same statewide standards. There is a large amount of 
freely available data describing exam results. The Illi¬ 
nois State Board of Education makes aggregate data for 
all public schools available each year [T]. Unfortunately 
the abundance of data is hard to decipher. We use vi¬ 
sualization techniques to display and identify patterns in 
the data. 

Our method of analysis is deliberately simple: scatter 
plots are employed to detect patterns. Our methods are 
different from multivariate regressions, which are com¬ 
monly used to study data of this type. We suspect such 
multivariate regressions make it difficult for the public 
to understand the data. The statistical methods and 
results require specialized software and training to inter¬ 
pret. Thus, before data enter public discourse, they typi¬ 
cally pass through a study or report in which the complex 
statistical computations are performed, and their conclu¬ 
sions are deduced for the lay audience. Such models are 
not necessary to extract results in this instance. 

Representation by statistical models and analyses is 
often said to be necessary, because raw data provide us 
with so many numbers that one cannot make sense of 
them. However visual images present a way to display 
a large number of data points simultaneously, making 
visualization an important part of science, particularly 
in the study of complex phenomena. Statistical analysis 
is often needed to separate true patterns from those due 
to chance. This is particularly true in settings where 
the number of data points is small or the scatter is very 
large. However, in the cases we will examine, the number 
of data points is so large and the unveiled patterns so 


clear, that elaborate statistical methods are not needed 
to establish them. The scatter plots have an impact that 
multivariate regressions lack. We apply simple regression 
techniques to show that the patterns found visually are 
statistically meaningful. 

We explore connections between exam performance in 
Illinois schools and various factors, with a particular fo¬ 
cus on poverty concentration as represented by a con¬ 
ventional proxy: the percent of students who qualify for 
lunch at free or reduced price. Poverty concentration of 
a school is strongly connected with its performance on 
standardized exams, as has been shown before [2H7]. In 
general, as poverty concentration rises, test scores fall. In 
most cases, this remains true for charter schools, which 
have more autonomy than the traditional public schools 
and have been widely promoted as a way for students to 
escape unsuccessful local schools. 

We consider additional factors aside from poverty: lo¬ 
cation and selective programs. We also study the perfor¬ 
mance over time. Poverty concentration influences per¬ 
formance in Chicago schools differently than the rest of 
the state. Additionally, the state has a number of se¬ 
lective schools, where students are chosen by their test 
scores. These schools do not exhibit the patterns relating 
poverty and test performance. The comparisons between 
selective and open-admissions programs are most strik¬ 
ing for high schools. Lastly, there are noticeable changes 
over time, particularly in the performance of charter high 
schools. 

This paper is organized as follows: Section II describes 
the types of Chicago public schools and the high-stakes 
exams in Illinois public education. In Section III we de¬ 
scribe how performance on standardized exams depends 
on poverty concentration in Chicago compared to the rest 
of Illinois. The performance of different Chicago school 
types is also described. The achievement on measures of 
college readiness is discussed in Section IV. In Section V, 
we show how Chicago schools have been changing over 
time. We conclude in Section VI. 
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II. PUBLIC EDUCATION IN ILLINOIS 

According to the U. S. Census Bureau, Chicago is by 
far the largest city in Illinois with about 21% of the state’s 
12.8 million residents; the second largest city in Illinois, 
Aurora, IL, contains only about 1.5% of the state’s resi¬ 
dents [8] . The Illinois State Board of Education oversees 
performance of public education throughout the state 
and sets pre-Kindergarten to 12th grade education poli¬ 
cies, while local school districts monitor operation of 
public schools of the area. The Chicago Public School 
System is the third largest school district in the United 
States and includes about 660 elementary and secondary 
schools. Chicago holds 17% of Illinois public schools and 
serves about 400,000 students [9]. Most Chicago schools 
are conventional neighborhood programs, but there are 
also several non-traditional school options. The school 
types discussed in this article are defined as follows m- 

Career Academy: Students receive career-focused 
education and hands-on experience in fields such as 
health, communications, or manufacturing 

Charter: Independently operated schools open to all 
Chicago students; students are admitted based on lottery 
if the number of applicants exceeds the available slots 

Magnet: Places importance on one particular subject 
area, such as international studies or fine arts; students 
are typically chosen by lottery after submitting an appli¬ 
cation 

Military Academy: Students wear uniforms and are 
taught in a structured environment focused on build¬ 
ing team and leadership skills; there are no attendance 
boundaries for application 

Neighborhood: Traditional programs; students who 
live within the school’s residential boundary do not sub¬ 
mit an application to enroll in the school 

Selective Enrollment: Academically advanced pro¬ 
grams providing accelerated, college preparatory instruc¬ 
tion; enrollment is based on entrance and/or standard¬ 
ized exam scores; they include regional gifted centers 
housed within neighborhood or magnet schools, where 
there are two separate programs within the school 

Charter schools receive considerable attention, since 
they are publicly funded schools that operate without the 
managing control of the school system m- These schools 
have been in place in Illinois since 1996 with the purpose 
of using innovative practices, such as longer school days, 
autonomy to hire teachers, or subject-focused curricula, 
to better serve at-risk children [12]. As of the 2013- 
2014 academic year, about 75 percent of Illinois charter 
schools were in the Chicago Public School system, and 
these programs served about 49,500 students in Chicago 
[1]. Many charter programs have several locations, and 
the city has about 130 charter campuses [9]. The growth 
of charter schools has been promoted in Chicago as an 
effort to improve the city’s education system uni HD. 
Therefore, in spite of recent education budget cuts and 
neighborhood school closings m, new charter schools 


are steadily opening each year m- Accordingly, the 
performance of charter schools has been the subject of 
several reports [T6HT9], whose strongly differing conclu¬ 
sions illustrate the degree to which regression methods 
alone divide specialists and baffle the public. The goal of 
this paper is not to argue the effectiveness of any school 
type. Instead we describe powerful ways to analyze the 
school’s performance on standardized exams and suggest 
that simpler formal methods aid in reaching consensus. 

Standardized exams play an important role in provid¬ 
ing the data on which public officials base decisions about 
educational policy. Starting at 3rd grade, Illinois pub¬ 
lic school students are required to take standardized ex¬ 
ams to evaluate their development during the year. Ex¬ 
ams cover subject areas such as mathematics, reading, 
science, and writing. The Illinois State Board of Edu¬ 
cation (ISBE) is responsible for forming the assessment 
each year, and the student, teacher, school, district, and 
state are all reviewed based, in part, on the exam re¬ 
sults. In 2014, Illinois adapted the Common Core State 
Standards, which assess Math and English language skills 
that students are expected to know after each grade [20| . 

Scores are reported in terms of score ranges determined 
by the ISBE, and students are graded with one of the 
following performance levels: Exceed Standards, Meet 
Standards, Below Standards, or Academic Warning m- 
A student passes the exam by meeting or exceeding stan¬ 
dards of each subject test. Achievement scores at the 
school level are expressed as the percent of students in 
the school who reach each performance level. Standard¬ 
ized exams, such as the ACT [22|, are used as a measure 
of college readiness; there is commonly a minimum re¬ 
quired score for scholarships or admission into some se¬ 
lective universities. Up to the 2014 testing season, the 
ACT was given to Illinois high school juniors as part of 
the mandatory Prairie State Achievement Exam (PSAE); 
the ACT will become optional in 2015 [23|. Table lists 
information about standardized math exams in Illinois. 

Benchmarks are set for the education system each year, 
and scores must be reported for school, district, and state 
accountability purposes. Schools are then classified ac¬ 
cording to success at meeting the targets and may be 
closed if student performance goals are not met. New ed¬ 
ucational policies are also implemented to improve stu¬ 
dents’ scores [T4|. In April 2014, Illinois joined many 
other states receiving a waiver from the No Child Left 
Behind law m, protecting school districts from penalty 
if testing benchmarks are not met. This is in exchange 
for a package of additional reform measures. It is there¬ 
fore useful to have ways to display how schools have per¬ 
formed and show the effects of such policies. All school- 
level performance data is available from ISBE, including 
school programs, performance scores, and demographics. 
Through data visualization of school scores, we find and 
interpret patterns among school characteristics. 
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Exams 

Grades 

Description 

Scores 

Illinois Standards Achievement Test 
(ISAT) 

1 

CO 

Measures student math achievement 
each year 

Performance level assigned based on 
fixed scale 

Prairie State Achievement Exam 
(PSAE) 


Assesses student preparation for post¬ 
secondary education and ability to ap¬ 
ply math skills to workplace 

Scores range from 120 to 200; perfor¬ 
mance level assigned based on fixed 
scale 

ACT 


Exam commonly used for admissions 
into four-year colleges and universities 

Scores range from 1 to 36 


TABLE L Description of standardized exams from which scores are used for this analysis. 


III. POVERTY AND SCHOOL PERFORMANCE 
IN AND OUT OF CHICAGO 

Figure [^a) displays the performance of 670 Illinois 
public high schools as a function of poverty concentra¬ 
tion. In this case, the measure of school achievement is 
given as the percentage of students in the school who 
met or exceeded ISBE standards of the 2013 Mathemat¬ 
ics PSAE, an exam given to high school juniors [25l [26] . 
Poverty concentration is defined as the percent of stu¬ 
dents who received lunches at no or reduced cost based on 
the maximum family income requirement. This is a stan¬ 
dard measure of poverty in schools. For the 2013-2014 
academic year, a family of four with an annual household 
income below $43,568 qualified for the free/reduced lunch 
program m- Low-income families choosing not to sign 
up for the lunch program are not represented. Two ad¬ 
ditional factors are expressed in this visualization by the 
color and size of each circle: the percent of minority stu¬ 
dents (African American and Hispanic) and the number 
of test takers at each school, respectively. Several schools 
were excluded from the data either for not completely re¬ 
porting information or for reporting 0% of students pass¬ 
ing. (Waukegan, IL area schools are not displayed due 
to a discrepancy in 2013 poverty concentration informa¬ 
tion.) Data for PSAE Reading and Science exam scores 
follow similar patterns as described here. For brevity, 
only Math exam performance is shown in this paper. 

Performance is strongly connected with concentration 
of low-income students, as shown by the significant de¬ 
cline in the percent of students passing with increas¬ 
ing poverty concentration. Within many schools in low- 
income neighborhoods (those with greater than 80% 
poverty concentration), less than 50% of students pass 
the exam. There is also a connection with minority con¬ 
centration; the coloring on the graph shows a strong 
correlation between poverty concentration and minority 
concentration. In 2013, 65% of White Illinois students 
passed the exam compared to only 36% of Hispanic stu¬ 
dents and 21% of African American students [T]. 

There are many outliers from the overall decline of 
performance with poverty shown in Fig. I^a). How¬ 
ever, when we remove all schools located in Chicago, as 
shown in Fig. 1(b), the remainder of the state’s schools 
present a remarkably tight relationship between poverty 
concentration and passing fraction. For example, there 
are almost no schools with more than 80% poverty con- 
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FIG. 1. (a) Percent of 11th graders at each Illinois school who 
passed the 2013 Math PSAE as a function of poverty concen¬ 
tration. The area of each point represents the number of test 
takers, and the color represents the percentage of minority 
students, (b) Same as (a) but excluding Chicago schools. It 
becomes particularly clear that Illinois school performance is 
very tightly correlated with poverty concentration and con¬ 
centration of minority students. 


centration and more than 40% students passing, as there 
are no schools with less than 20% poverty concentration 
and less than 40% students passing. 
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FIG. 2. (a) Percent of 11th graders at Chicago schools only 
who passed the 2013 Math PSAE as a function of poverty 
concentration. The size and color of the points represent the 
number of test takers and percent of minority students respec¬ 
tively. (b) Chicago schools are again presented; in this case, 
symbols indicate the type of school as given in the table. 


When only Chicago schools are considered, we find 
that the relationship between poverty concentration and 
passing fraction is possible to break. Figure [^a) shows 
the performance of 115 Chicago schools. They clearly do 
not show the same association with poverty as in Fig. 
Bb)- Most schools have a poverty concentration greater 
than 50%, and among these schools we see significant 
variations in performance. For comparison, Aurora, the 
second largest city in Illinois, only has four high schools, 
and these schools all fit well on the trend shown in Fig 
Bb). Schools in the areas surrounding Chicago, includ¬ 
ing Will, Lake, Dupage, and Cook counties, also fit Fig. 


Bb) well. Only Chicago is different. 

Chicago has several types of programs, as highlighted 
in Fig. Bb): career or military, charter, magnet, se¬ 
lective enrollment, and neighborhood. There is a fairly 
large spread in achievement among neighborhood, ca¬ 
reer/military, and charter schools, though most have less 
than 50% passing. One exception is the Noble Street 
Charter System where 89% are considered low-income 
and 63.6% of the 1,585 tested students passed the PSAE. 
The seven highlighted magnet schools also vary signifi¬ 
cantly. Von Steuben High School, with 59% passing at 
76% poverty concentration, and Devry Advantage High, 
with 78% passing at 83% poverty concentration, per¬ 
form better than anticipated based on the performance- 
poverty concentration trend. Two magnet programs 
show surprisingly low performance scores. Administra¬ 
tors of Crane Medical Prep High School, at 2% pass¬ 
ing, attribute this to reporting error, while Clark Aca¬ 
demic Prep, which fits the pattern in Fig[^b) with 86% 
poverty concentration and 10% passing, is now on pro¬ 
bation. As one might expect, the selective enrollment 
programs, which have competitive admissions and ac¬ 
celerated instruction, have results superior to all other 
Chicago schools, with several having over 90% of students 
passing the Math PSAE. Regional gifted centers, smaller 
programs housed within neighborhood or magnet schools, 
are featured as selective enrollment programs. For in¬ 
stance, Morgan Park High school has an international 
studies gifted program within the traditional school and 
is noted in Fig. |^b) as a selective enrollment program 
with 37% passing. 

Proceeding to examine lower grades, we find a very 
similar set of patterns: school performance outside of 
Chicago clusters tightly around a line where performance 
declines as poverty rises. Chicago schools show more 
complex patterns, which depend, in part, on school type. 
In grades 3 through 8, students’ accomplishment is mea¬ 
sured through the ISAT, and, as with the PSAE, “pass¬ 
ing” is equivalent to meeting or exceeding exam stan¬ 
dards. For each grade level, we find the percent of stu¬ 
dents passing the 2013 exam at Illinois schools, excluding 
Chicago, as a function of poverty concentration; this is 
shown in Fig. 

Since passing fractions of Illinois schools outside of 
Chicago clearly show a linear relationship with poverty 
concentration, we can perform simple regressions to ob¬ 
tain the best fit line fi to describe these patterns. The 
quality of the fit is depicted by its standard deviation a, 
the amount of variation from the line. The regression line 
equations and their corresponding a are given in Table 

nn 

We continue to a comparison of performance at schools 
in and out of Chicago. Figure |^a) gives examples of how 
Chicago area schools, excluding selective enrollment pro¬ 
grams, perform at 8^^ and grades compared to those 
of the rest of the state. The solid line indicates the best fit 
line for each set of data, and the shaded region surround¬ 
ing the line shows its standard uncertainty. At grade 
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FIG. 3. Illinois school performance, excluding Chicago schools, on the 2013 Math ISAT at grades 3 through 8. The area of 
each point represents the total number of students tested at each school, and the color represents the percentage of minority 
students in the school. Performance declines with increasing poverty concentration. 


Grade 

Regression Line 

<7 

3 

/ = -0.56ci + 83.7 

11.9 

4 

/ = -O.Slci + 86.0 

12.2 

5 

/ = -0.52ci + 85.2 

12.4 

6 

/ = -0.53ci + 85.5 

12.5 

7 

/ = -0.54ci + 82.9 

12.1 

8 

/ = -0.54ci + 82.5 

12.1 

11 

/ = -0.67ci + 76.5 

10.6 


TABLE II. Regression lines for passing fraction pi versus 
poverty concentration Ci plots of each grade level (Figs. 1(b) 
and 3), and the respective standard deviations a. Data are for 
2013 Mathematics exams and apply to Illinois schools outside 
of Chicago. 


8, many of the Chicago schools (shown in blue) earned 
higher scores than the average of non-Chicago programs 
(shown in red), though there is a large spread among 
Chicago schools. Similar patterns appear at 3^^ to 7^^ 
grades. However, for grade scores, the difference 
between Chicago and other Illinois schools is not as sig¬ 
nificant over the full range of poverty concentration. The 
performance of Chicago high schools is best examined by 


considering programs in which at least 48% of students 
are identified as low-income, a criterion that applies to 
103 of the 105 career, charter, neighborhood, magnet, 
and military schools represented. Since data for less than 
48% poverty concentration is so sparse in Chicago, we 
discard this region from the comparison. When restrict¬ 
ing attention to the range of 48-100% poverty concentra¬ 
tion, we find that Chicago high schools have significantly 
higher scores than schools in the rest of Illinois, except for 
the highest poverty schools where the difference vanishes 
on average. 

Figure |^b) shows how much each type of school in 
Chicago deviates from the fit for the rest of the state 
(dashed line) at 3'^^ through 8^^ and 11^^ grades. Ca¬ 
reer and Military schools are excluded. For 11^^ grade, 
only schools with poverty concentration higher than 48% 
are considered. We define for a school i to be the 
difference between the actual passing fraction pi and the 
fraction fi we would anticipate based upon the best fit 
line of Illinois schools (excluding Chicago) appropriate 
for that grade at poverty concentration q. The value of 
A^, is positive (negative) if the school performs better 
(worse) than expected for other Illinois programs. The 
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average difference is weighted by the number of test tak¬ 
ers at each school. For example, the average difference 
of Chicago magnet schools is given by 




G magnet 


(AiNi) 


E. 


iG magnet 




( 1 ) 


where No is the number of students in each school and 


the total number of schools is given in Table III 


Grade 

Charter 

Magnet 

Selective 

Neighborhood 

Illinois 

3 

21 

35 

14 

427 

1685 

4 

21 

36 

14 

422 

1654 

5 

24 

36 

14 

421 

1571 

6 

23 

37 

14 

405 

1107 

7 

24 

38 

17 

390 

913 

8 

22 

37 

18 

389 

911 

*11 

22 

6 

6 

63 

129 


TABLE III. Number of schools represented by each point of 
Fig. 4(b). * At grade 11, only schools with more than 48% 
concentration of low-income students are considered. 

At every grade level, all Chicago school types, includ¬ 
ing neighborhood schools, perform better, on average, 
than expected based on achievement of the rest of the 
state. Neighborhood schools have increasingly better 
performance up to grade 8. At 11^^ grade, Chicago’s 
neighborhood programs score slightly above the rest of 
the state though less pronounced than at lower grades. 
Additionally, charter school systems perform below other 
Chicago schools at grades 5 and 8, and magnet programs 
lie consistently above charter and neighborhood schools. 
Selective enrollment schools, not surprisingly, have the 
highest performance at all grades. This is especially strik¬ 
ing at grade where selective enrollment programs 
show a significant jump, while neighborhood schools de¬ 
cline. In high school, most gifted programs are full-site 
centers, meaning that all students follow the more rigor¬ 
ous curriculum. In contrast, ten of the elementary level 
selective enrollment programs are regional gifted centers. 
High school students in selective programs must also have 
demonstrated high scores on previous standardized ex¬ 
ams (ISAT). On the other hand, elementary students are 
admitted based on a school’s entrance exam and not nec¬ 
essarily performance on standardized state exams. This 
likely contributes to the increased difference at grade 
compared to lower grades in gifted programs. 


IV. MEASURE OF COLLEGE READINESS 

The ACT measures college readiness at high schools. 
Accordingly, we note whether, on average, students of 
Illinois schools are attaining satisfactory ACT scores. Up 
to the 2014-2015 academic year, Illinois graders took 
the ACT for free as part of the mandatory state adminis¬ 
tered exams offered to public school students [23] . There- 
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FIG. 4. (a) Math performance scores of Chicago schools 

(blue) are compared to the fit to the data of other Illinois 
schools (red) at 8^^ and grades. Transparent bands in¬ 
dicate the standard uncertainty of each line, (b) Average dif¬ 
ferences of 2013 Math exam performance at Chicago school 
programs when compared to Illinois schools of smaller com¬ 
munities. The average difference A of each school category 
is determined by T>Ni{pi — fi{ci))/'ENi, where pi is the per¬ 
cent passing at each school, fi is the expected performance at 
that grade level based on the poverty concentration a of the 
school, and Ni is the number of students in each school of that 
category. Table [Hi] gives the number of schools represented. 
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fore, the ACT is the key exam for college admissions, as 
opposed to the SAT. 
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FIG. 5. Average Math ACT score of each Illinois school, 
(a) Math ACT score as a function of poverty concentra¬ 
tion. The color of the points indicates the percent of mi¬ 
nority students at each school, (b) School types are high¬ 
lighted: Chicago charter schools, selective enrollment schools 
in Chicago, neighborhood schools in Chicago, and the rest of 
Illinois. 

Figure a) shows the average Math ACT score of each 
Illinois high school as a function of poverty concentration. 
As with other state standardized exams, ACT Math per¬ 
formance declines with increasing concentration of low- 
income students. This is in agreement with a study of 
Dixon-Roman et. al. indicating a correlation between 
parental income and student’s performance on college 
readiness exams [28]. Most schools with less than 20% 
poverty concentration have an average score above 20, 
while, among schools with more than 80% poverty con¬ 
centration, few have an average score above 20. The 
influence of poverty on college admissions exam scores is 
not unique to Illinois schools. For other states that have 
been examined, poverty is also connected to school per¬ 
formance in Mathematics [6]. Similarly, performance de¬ 
clines with increased concentration of minority students. 

We study how Chicago schools possibly diverge from 
this trend, as seen with scores of the PSAE and 
IS AT. In Fig. [5];b), we highlight schools located in 


Chicago. The symbols represent the different types of 
programs: Chicago charter, Chicago selective enrollment, 
Chicago neighborhood, or Illinois, excluding Chicago. 
All Chicago neighborhood schools cluster at average 
scores of about 15 to 20, and there is no significant trend 
with poverty among neighborhood schools. The best 
performing schools are all selective enrollment, college 
preparatory schools in Chicago, although performance in 
these schools does decline with poverty. With an average 
score of 17.9, Morgan Park High, a regional gifted center, 
is the lowest among gifted programs. 

Previous analyses show that attending a Chicago char¬ 
ter high school may have positive effects on ACT scores 
m- It is often argued that charter schools improve 
student achievement due to innovative methods of in¬ 
struction and discipline to prepare students for college. 
However, our present study indicates that scores of most 
charter schools cluster around similar scores to neighbor¬ 
hood schools at the same poverty level, as was also noted 
in a recent report m- There is an exception: the No¬ 
ble Street Charter System with an average score of 21.2. 
Note that ISBE reports only one score of all campuses 
of charter school systems, such as Noble Street Char¬ 
ters. According to a separate performance report from 
the Chicago Public School System, the average scores on 
the 2013 Math ACT among Noble Street schools ranged 
from 19.2 at the Rowe-Clark campus to 23.7 at the UIC 
campus [29] . 

V. SCHOOL PERFORMANCE OVER TIME 

Thus far we have only considered school performance 
in 2013, comparing various types of educational programs 
at each grade level. In this section we address the evo¬ 
lution of these results over time. For example, the num¬ 
ber of charter schools in Chicago has grown consistently 
as new schools and locations open. Accordingly, we ask 
if there has been an overall improvement of the charter 
school system as it grew. Figureshows the total percent 
of 11^^ grade students in Chicago charter and neighbor¬ 
hood high schools (excluding selective enrollment, mag¬ 
net, career, and military schools) who passed the Math 
PSAE each year. The numbers of schools and students 
represented are given in the table of Fig. The percent 
of students passing is obtained by the fraction of the sum 
of all students in each charter or high school who met or 
exceeded exam standards to the total number of students 
tested in those schools each year: 

^(Pi * Nj) 

T,Ni '■ ’ 

where pi is the percent passing and Ni is the number 
of students tested at each school of the program type 
(charter or traditional) in each year. The concentration 
of low-income students is not considered in this compar¬ 
ison. 
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1 1 

2005 1 

2006 

1 2007 

1 2008 

1 2009 

1 2010 1 

1 2011 1 

1 2012 1 

2013 1 



Number of School Systems 

Charter 

7 

8 

9 

11 

13 

14 

15 

18 

22 

Neigh. 

53 

58 

58 

67 

62 

65 

67 

64 

64 


Number of Students Tested 

Charter 

735 

882 

1026 

1131 

1869 

2489 

3926 

4688 

5305 

Neigh. 

11287 

11140 

11807 

14099 

13640 

12832 

14452 

13987 

13297 


FIG. 6. Percent of Chicago charter and traditional high school 
students who passed the Math PSAE each year. There was 
a performance shift in 2009 after which a greater percent 
of charter students passed. Neighborhood schools have im¬ 
proved at about 1.5% per year from 2009-2013, compared 
to 0.8%/year among charter schools, as determined from the 
slopes of each ht. The table gives the number of schools and 
the number of students tested each year in those schools. 


The percentage of students passing remained at only 
about 18% to 33% at Chicago neighborhood and charter 
programs from 2005 to 2013, compared to about 60% of 
Illinois school students of other communities (due to the 
lower concentration of low-income students). Up to 2008, 
charter schools consistently performed at the same level 
as other high schools in the percent of students passing 
the exam. However, in the last several years, there has 
been a shift in performance; between 25% and 30% of 
charter students passed the exam each year since 2009. 
Charter school scores have increased by about 0.8% per 
year from 2009 to 2013. Although neighborhood high 
schools in Chicago have improved by about 1.5% each 
year, the traditional programs have not reached the per¬ 
formance of charter schools. 

Some charter programs have been criticized for their 
high attrition rates m; charters expel poorly performing 
students at a higher rate than at other public schools, re¬ 
sulting in a boost in test scores. Chicago Public Schools 
recently released data that support the claim [31]. The 
expulsion rates of 2012-2013 at Chicago charters was 
0.61% compared to only 0.05% at traditional schools. 
Some charter programs noted for high academic perfor¬ 
mance have expelled 1.5 - 4.8% of the student body dur¬ 
ing the year [29]. Here we provide a rough estimate of 
the impact of high expulsion rates on Math PSAE per¬ 
formance: We assume the extreme case where all ex¬ 
pelled students would not have passed the exam and 


were thereby transferred to a neighborhood school. If 
those students were not expelled and were instead tested 
in a charter program, the resulting percent passing in 
2013 among charter students would have been 29% and 
would have increased among neighborhood students to 
24%. Thus, the higher scores of charter programs are 
not fully explained by their higher expulsion rates. 

The number of charter systems has increased in the last 
nine years from 7 in 2005 to 22 in 2013, not including new 
campuses of established systems; there were 54 charter 
high school campuses as of the 2012 academic year. Note 
that charter systems with several locations may report 
scores and demographics as one school. In 2008-2009, the 
number of charter school 11^^ graders grew by 65%, while 
some traditional public schools were closed or relocated 
as part of the Renaissance plan of Chicago Public Schools 
m- This must have contributed to the shift apparent 
in 2009. Even if charter schools pulled stronger students 
away from neighborhood schools after 2009, the data in 
Fig. 4(b) indicate the net result for Chicago has been 
positive. When considering the scores of each charter 
school separately, we find that most schools do not have a 
major change in the percent of students passing the exam 
over several years. Schools that start with strong scores 
typically remain at the same level, and schools with lower 
scores do not usually improve. Over the last five years, 
there have been new charter programs opening, and some 
of the schools have better performance scores within the 
first year than established traditional high schools. Ac¬ 
cordingly the overall achievement of charter schools on 
the grade Math exam has been above that of neigh¬ 
borhood schools. 


VI. CONCLUSIONS 

We have analyzed standardized exam performance at 
Illinois schools from 2005 to 2013, making use of pub¬ 
lic data that anyone can access. Through data visu¬ 
alization methods commonly used in science, we reveal 
clear patterns in Illinois education. We have shown that 
performance at all schools outside of Chicago, depends 
very consistently upon poverty concentration. Outside 
Chicago, no schools in Illinois with a high concentra¬ 
tion of low-income students have performance scores as 
great as schools in better-off communities with a poverty- 
concentration less than 20%. In Chicago, the story is 
more complicated. Schools in the city have higher scores, 
on average, than the rest of the state at each grade and 
poverty level. Performance of Chicago schools depends, 
in part, on the type of program, such as programs for 
gifted students and networks of charter schools. Selective 
enrollment programs consistently have the highest exam 
achievement compared to other public schools. This is 
especially true at grade. These programs also ex¬ 
cel in measures of college readiness, such as the ACT, 
though scores are shown to decline with poverty con¬ 
centration in this case. In 2013, neighborhood schools 
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performed better than charter schools in grades 5 and 8, 
and neighborhood and charter high schools have earned 
similar ranges of performance scores on the ACT. While 
schools in the rest of Illinois displayed a largely static and 
discouraging dependence of test performance on poverty, 
Chicago has improved over the nine year period we exam¬ 
ined. In 2009, charter high schools had a shift in scores 
from about 20% to 30% passing math exams, while tra¬ 
ditional schools have gradually improved since 2009. The 
overall picture is one in which change in Chicago school¬ 
ing has produced improvement in test scores for students 
at all levels of poverty and in all types of schools. Mean¬ 


while, in the rest of the state, the dependence of scores 
on poverty is stronger and is not changing. 
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